Goto

Collaborating Authors

 immersive experience


Experiential entertainment is having a gold rush but commercial success is far from certain

The Guardian

W hen the first ever stage adaptation of the global book and film franchise The Hunger Games opens its doors in London next week, fans paying up to £200 have been promised an "electrifying" and "immersive" experience. The show at the purpose-built 1,200 seat Troubadour in Canary Wharf, which features Hollywood A-lister John Malkovich appearing via screen as the evil President Snow who oversees the televised spectacle of teenagers fighting to the death, is the latest in an explosion of launches looking to cash in on a boom in consumer demand for experiential entertainment, often linked to bankable franchises. The boom in the market for experimental, unusual nights out and shows is well established, from escape rooms, axe throwing and slumber parties to Secret Cinema's Olympic Park takeover to recreate the setting for Back to the Future and the hugely successful Abba Voyage. Recent pop-ups include experiences linked to Minecraft, Jurassic World and Squid Game. As big money has rolled into the sector, so too has a desire from companies to rely on solid gold intellectual property to bring in the crowds - with mixed results.


Perspective-Aware AI in Extended Reality

Platnick, Daniel, Gruener, Matti, Alirezaie, Marjan, Larson, Kent, Newman, Dava J., Rahnama, Hossein

arXiv.org Artificial Intelligence

AI-enhanced Extended Reality (XR) aims to deliver adaptive, immersive experiences--yet current systems fall short due to shallow user modeling and limited cognitive context. We introduce Perspective-Aware AI in Extended Reality (PAiR), a foundational framework for integrating Perspective-Aware AI (PAi) with XR to enable interpretable, context-aware experiences grounded in user identity. PAi is built on Chronicles--reasoning-ready identity models learned from multimodal digital footprints that capture users' cognitive and experiential evolution. PAiR employs these models in a closed-loop system linking dynamic user states with immersive environments. We present PAiR's architecture, detailing its modules and system flow, and demonstrate its utility through two proof-of-concept scenarios implemented in the Unity-based Open-Dome engine. PAiR opens a new direction for human-AI interaction by embedding perspective-based identity models into immersive systems.


Immersive Multimedia Communication: State-of-the-Art on eXtended Reality Streaming

Wang, Haopeng, Dong, Haiwei, Saddik, Abdulmotaleb El

arXiv.org Artificial Intelligence

Extended reality (XR) is rapidly advancing, and poised to revolutionize content creation and consumption. In XR, users integrate various sensory inputs to form a cohesive perception of the virtual environment. This survey reviews the state-of-the-art in XR streaming, focusing on multiple paradigms. To begin, we define XR and introduce various XR headsets along with their multimodal interaction methods to provide a foundational understanding. We then analyze XR traffic characteristics to highlight the unique data transmission requirements. We also explore factors that influence the quality of experience in XR systems, aiming to identify key elements for enhancing user satisfaction. Following this, we present visual attention-based optimization methods for XR streaming to improve efficiency and performance. Finally, we examine current applications and highlight challenges to provide insights into ongoing and future developments of XR.


Recent Advances and Future Directions in Extended Reality (XR): Exploring AI-Powered Spatial Intelligence

Zeng, Baichuan

arXiv.org Artificial Intelligence

Extended Reality (XR), encompassing Augmented Reality (AR), Virtual Reality (VR) and Mixed Reality (MR), is a transformative technology bridging the physical and virtual world and it has diverse potential which will be ubiquitous in the future. This review examines XR's evolution through foundational framework - hardware ranging from monitors to sensors and software ranging from visual tasks to user interface; highlights state of the art (SOTA) XR products with the comparison and analysis of performance based on their foundational framework; discusses how commercial XR devices can support the demand of high-quality performance focusing on spatial intelligence. For future directions, attention should be given to the integration of multi-modal AI and IoT-driven digital twins to enable adaptive XR systems. With the concept of spatial intelligence, future XR should establish a new digital space with realistic experience that benefits humanity. This review underscores the pivotal role of AI in unlocking XR as the next frontier in human-computer interaction.


'Wizard of Oz' AI makeover is 'total transformation,' sparking mixed reactions: experts

FOX News

Fox News correspondent William La Jeunesse joins'Fox News Sunday' to discuss the evolution of AI and the push lawmakers are making to regulate it. The use of artifical intelligence to reimagine the classic film "The Wizard of Oz" will likely see mixed reactions from fans, experts told Fox News Digital. While "film purists" may resist the idea of using generative AI to give classic films an entire makeover, the technology could "breathe new life" into hit movies -- including "The Wizard of Oz." Warner Bros. Discovery, Google Cloud and Magnopus have set out to do just that by creating an immersive experience for fans of the 1939 classic. The new "Wizard of Oz" experience is set to premiere at the Las Vegas Sphere on Aug. 28. "The fan reaction will likely split into two distinct camps," Michael Walker, CEO of AI-First at Trilogy, told Fox News Digital.


Walk through your future home or business space before construction starts

FOX News

Avoid costly surprises down the line and make sure your final product is what you envisioned. Are you ready to step into your dream home or office, feeling every dimension as if it were already built? With some pretty cool tech, you can do just that by walking through your future space at its actual size and experimenting with layouts and furniture in real time. This isn't just about visualizing your space; it's about avoiding costly surprises down the line and making sure your final product is exactly what you envisioned. By experiencing your plans in a life-like setting, you can refine your vision, ensuring your project stays on budget and matches your dreams.


Spatial Computing: Concept, Applications, Challenges and Future Directions

Yenduri, Gokul, M, Ramalingam, Maddikunta, Praveen Kumar Reddy, Gadekallu, Thippa Reddy, Jhaveri, Rutvij H, Bandi, Ajay, Chen, Junxin, Wang, Wei, Shirawalmath, Adarsh Arunkumar, Ravishankar, Raghav, Wang, Weizheng

arXiv.org Artificial Intelligence

Spatial computing is a technological advancement that facilitates the seamless integration of devices into the physical environment, resulting in a more natural and intuitive digital world user experience. Spatial computing has the potential to become a significant advancement in the field of computing. From GPS and location-based services to healthcare, spatial computing technologies have influenced and improved our interactions with the digital world. The use of spatial computing in creating interactive digital environments has become increasingly popular and effective. This is explained by its increasing significance among researchers and industrial organisations, which motivated us to conduct this review. This review provides a detailed overview of spatial computing, including its enabling technologies and its impact on various applications. Projects related to spatial computing are also discussed. In this review, we also explored the potential challenges and limitations of spatial computing. Furthermore, we discuss potential solutions and future directions. Overall, this paper aims to provide a comprehensive understanding of spatial computing, its enabling technologies, their impact on various applications, emerging challenges, and potential solutions.


Apple Vision Pro hands-on, redux: Immersive Video, Disney app, floating keyboard, and a little screaming

Engadget

With pre-orders for the Apple Vision Pro headset opening this week, the company is getting ready to launch one of its most significant products ever. It announced this morning an "entertainment format pioneered by Apple" called Apple Immersive Video, as well as new viewing environments in the Disney app featuring scenes from the studio's beloved franchises like the Avengers and Star Wars. We already got hands-on once back at WWDC when the headset was first announced, but two of our editors, Dana Wollman and Cherlynn Low, had a chance to go back and revisit the device (and Dana's case, experience it anew). Since we've already walked you through some of the basic UI elements in our earlier piece, we decided to focus on some of the more recently added features, including Apple Immersive Video, the new Disney environments, a built-in "Encounter Dinosaurs" experience, as well as the floating keyboard, which didn't work for us when we first tried the device in June of last year. Here, too, we wanted to really get at what it actually feels like to use the device, from the frustrating to the joyful to the unintentionally eerie.


Metaverse: A Vision, Architectural Elements, and Future Directions for Scalable and Realtime Virtual Worlds

Ismail, Leila, Buyya, Rajkumar

arXiv.org Artificial Intelligence

With the emergence of Cloud computing, Internet of Things-enabled Human-Computer Interfaces, Generative Artificial Intelligence, and high-accurate Machine and Deep-learning recognition and predictive models, along with the Post Covid-19 proliferation of social networking, and remote communications, the Metaverse gained a lot of popularity. Metaverse has the prospective to extend the physical world using virtual and augmented reality so the users can interact seamlessly with the real and virtual worlds using avatars and holograms. It has the potential to impact people in the way they interact on social media, collaborate in their work, perform marketing and business, teach, learn, and even access personalized healthcare. Several works in the literature examine Metaverse in terms of hardware wearable devices, and virtual reality gaming applications. However, the requirements of realizing the Metaverse in realtime and at a large-scale need yet to be examined for the technology to be usable. To address this limitation, this paper presents the temporal evolution of Metaverse definitions and captures its evolving requirements. Consequently, we provide insights into Metaverse requirements. In addition to enabling technologies, we lay out architectural elements for scalable, reliable, and efficient Metaverse systems, and a classification of existing Metaverse applications along with proposing required future research directions.


Pushing Buttons: Why the closure of Disney's Star Wars hotel isn't the end of immersive gaming

The Guardian

Next month, Disney's immersive Galactic Starcruiser "Star Wars hotel" in Florida will shut down, less than two years after opening. Best known for being horrendously expensive – $4,809 for a couple for two nights, or a mere $1,500 a person if you fit four to a cabin – most have dismissed the Starcruiser as yet another of Disney's recent spendthrift follies. When I heard the news of its closure earlier this year, I rushed to book one of the remaining cabins. My path into the games industry was by playing alternate reality games (ARGs) that mixed real-world actors and events with online gameplay; I'd go on to make ARGs such as Perplex City and, more recently, augmented reality games like Zombies, Run! Even though I hadn't been impressed by the Starcruiser's marketing, I was desperate to see what an estimated $350m budget had produced.